Papers with word-level information transfer
Beyond Shared Vocabulary: Increasing Representational Word Similarities across Languages for Multilingual Machine Translation (2023.emnlp-main)
Copied to clipboard
| Challenge: | Using a shared vocabulary is common practice in multilingual machine translation . however, when words overlap is small, e.g., using different writing systems, knowledge transfer is inhibited . |
| Approach: | They propose a re-parameterized method for building word embeddings using word equivalence classes and graph networks to fuse word embeds across languages. |
| Outcome: | The proposed method achieves evident BLEU improvements on high- and low-resource MNMT scenarios. |